DESCRIPTION 



MULTI-PERSON SHARED DISPLAY DEVICE 

5 TECHNOLOGICAL FIELD 

The present invention relates to a display device. In particular, it is related to 
display device allowing a plurality of users to share a common display device. 

10 BACKGROUND TECHNOLOGY 

In recent years, computers and the environment surrounding computers has been 
rapidly expanding. Together with such expansion, technology using computers is widely 
used and has become commonplace so that these days computers can be seen in every aspect 

15 of our daily lives. 

Within this expansion of the environment surrounding computers, technology 
related to virtual reality is also expanding. The increasing speed of computers has made it 
possible to bring the construction of complicated virtual environments to even greater heights. 
Currently, this virtual reality technology has come to be used in various fields, and objects 

20 realized in virtual worlds are wide-ranging from large scale to small scale and high definition, 
such as outer space, metropolitan areas, environments in nature, manufactured products, 
internal organs, small animals, cells, and atoms. Moreover, not only is it being used for that 
which actually exists and can be actually seen, but also it is being used to visualize 
temperature distribution, airflow, and electromagnetic fields, which cannot actually be seen. 

25 Amazing expansion has been attained in three-dimensional image display 

technology used to achieve such virtual reality, and utilization thereof ranging from 
installations at expositions or use for amusement purposes, to applications in the fields of 
education and medicine and applications in the various design, CAD/ CAM, and 
measurement fields deserves our attention. 

30 Techniques of displaying three-dimensional images are generally classified into a 

technique where a stereoscopic image is formed using an appropriate method and having the 
viewer of such image view it without assistance, and a binocular disparity technique devised 
^ so that, instead of a stereoscopic image, a right-eye view and a left-eye view of a flat image is 
formed and the right-eye view is viewed by the right eye and the left-eye view is viewed by 
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the left eye. Typical examples of the former include holography and integral photography, 
and the latter includes three-dimensional movies where polarized glasses or liquid crystal 
shutters are used, and three-dimensional television using lenticular film. 

These techniques of forming three-dimensional images, as typified by holography, 
5 still have unresolved technical issues preventing full color, high resolution, and real time 
viewing. 

The binocular disparity technique is based on. ergonomics, and provides 
three-dimensional images giving an enhanced 'real' feeling, and superior immersion and 
sensory feelings. However, it is not possible to freely change the viewpoint from which the 
10 three-dimensional object shown is viewed to coordinate with the user's movements using this 
technique by itself. 

A method which modifies the three-dimensional image in accordance with the 
viewpoint and position of the viewer, a device (e.g., magnetic sensors or the like) worn for 
measuring the position of the head (viewpoint) of the viewer plus the binocular disparity 

15 technique allows the three-dimensional image to be viewed relative to the viewpoint position. 
However, with this technique, the number of users for which viewpoint movement within 
real-space can be reflected in the virtual world is limited to one person for each display. 
There is no display method appropriate for a plurality of viewpoints when a plurality of users 
shares a common display. 

20 There are methods of performing time divided display for the number of users (for 

example, refer to MIYASATO, Tsutomu, et al., General Conference of the Institute of 
Electronics Information and Communication Engineers, A 16-21, 1997, or Japanese Patent 
Application Laid-open Hei 10-260377) and methods of driving display devices corresponding 
to the number of users in response to viewpoint position (for example, refer to KIMURA, 

25 Katsuyuki, et al., Conference on Three-Dimensional Imaging, 5-7, 1994). However, with the 
former, as the number of viewers increases, the allowable lower frequency limit of the 
composition of the three-dimensional view is not reached (the number of frames decreases), 
the display frequency is in inverse proportion to the number of users, which cause problems 
such as flickers to occur. With the latter, the number of display devices matching the number 

30 of users or a large-scale device is required, which is problematic in terms of price. 

Thus, conventional devices for three-dimensional display of images and video have 
primarily come to use methods which display video for the right eye and video for the left eye 
using time division, and viewing is performed by putting on special glasses which open/close 
windows for the right and left eyes synchronous with the timing of this switching. In this 



case, the viewer is able to view the video via a screen from any position without distortion 
caused by that viewpoint positioning. 

However, if a plurality of people try to view the same three-dimensional video 
without distortion, since the display switches back and forth between the right eye and left 
5 eye video of a plurality of positions, the time interval between displaying an image for each 
person that has increased the number of time divisions becomes longer, causing a flicker to be 
sensed. 



DISCLOSURE OF INVENTION 

10 

An object of the present invention is to provide a multi-person shared display device 
capable of displaying in response to viewpoint movement in real space. Another object of 
the present invention is to provide a multi-person shared display device capable of displaying 
a three dimensional image. 

15 In order to achieve the above-mentioned objects, the present invention is a 

multi-person shared display device, in which a display device is shared by a plurality of users; 
it is characterized by comprising: a display device, which displays a plurality of video for a 
plurality of users on a screen; a display mask, which is disposed so as to cover said display 
device separated by a fixed distance and has a sufficiently large hole; a position sensor, which 

20 detects a location of a user in real space corresponding to said display device; and a 
processing device, which is dynamically combined with said one display device and said 
position sensor, and displays an image corresponding to each user upon said display device in 
accordance with the position of the user through said position sensor. 

The proposed multi-person shared display device uses a display mask in which a 

25 hole is formed and covers the display device so as to hide portions besides the hole, allowing 
different display regions upon the display device to be set in accordance with the viewpoint 
position within real space of each user. This makes it possible to perform display in response 
to viewpoint movements of a plurality of users. 

Video to be displayed upon a display device can include video for three-dimensional 

30 viewing. 

In this case, each user wears a plurality of glasses for separating said video for 
three-dimensional viewing displayed into that for the right eye and that for the left eye, and 
the plurality of video for three dimensional viewing shown on said display device, are images 
allowing separation between that for the right eye and that for the left eye through said 



plurality of glasses. 

Also, glasses in which shutters for the right eye and for the left eye open and close 
can be used as said glasses; and said processing device can be dynamically combined with 
said glasses. 

5 By forming said glasses and said position sensor as an integral unit, the position of a 

user can be found with little error. 

BRIEF DESCRIPTION OF DRAWINGS 

10 FIG 1 is a diagram showing a configuration of an embodiment of the present 

invention. 

FIG 2 is a diagram showing an example of a display according to an embodiment of 
the present invention. 

FIG 3 is a diagram showing an example of an image produced by this embodiment. 
15 FIG 4 is a diagram showing an example of coordinates in the case where viewpoint is 

calculated. 

FIG 5 is a diagram showing the relationship between the display surface and a 
virtual object. 

FIG 6 is a diagram showing how a coordinate axis is determined. 
20 FIG 7 is a diagram showing display area for the viewpoint of a user. 

FIG 8 is a diagram showing an embodiment of a theatre display device. 

FIG 9 is a diagram showing a configuration applied to entertainment purposes. 

FIG 10 is a diagram showing an example where information is displayed. 

25 BEST MODE FOR CARRYING OUT THE INVENTION 

Embodiments of the present invention are described forthwith while referencing the 
drawings. 

To begin with, an example where a three-dimensional image is shown with a 
30 multi-person shared three-dimensional display device is described. 

FIG 1(a) is a diagram showing a configuration of a multi-person shared 
three-dimensional display device according to an embodiment of the present invention. In 
FIG 1(a), two users 140 and 150 of a multi-person shared three-dimensional display device 
each have on liquid crystal shutter glasses 142, 152, respectively, and also have a respective 



position sensor 144, 154 attached. The users view an image displayed upon a display screen 
110 via the liquid crystal shutters. The liquid crystal shutter glasses 142, 152, position sensors 
144, 154, and display device 110 are connected to a processing device 130. In conformity with 
the input from the position sensors, the processing apparatus 130 displays an image upon the 
5 display at a region corresponding to each respective user. 

The display device 110, as shown in FIG 1(b), is configured from a display 112 and a 
display mask 114, which covers and hides a portion thereof. The display mask 114 is set at a 
position separated only an appropriate distance away from a display surface 116. A hole 118 
is formed in the display mask 114, and through only that portion can the surface 116 of the 

10 display 112 be seen. 

By introducing such a display mask 114, as shown in FIG 2, the viewable region 
upon the display surface varies depending on the viewpoint position of the user. As a result, 
it becomes possible to vary the contents exhibited to each user. In addition, with this 
configuration, it becomes possible to coordinate with the interactive viewpoint movement of a 

15 user. In the case where the viewpoint position of a user moves, the region viewable by the 
user also changes depending on that movement. Accordingly, by detecting viewpoint 
position using the position sensor and displaying at a region befitting that viewpoint position, 
it is possible to adapt to the movement of the viewpoint position of the user. 

Moreover, with a system using this technique, by presenting an image having 

20 disparity between the respective right and left viewpoint for every display region and for 
every viewpoint position, it becomes possible to perform three-dimensional display for all 
viewers. As a result, a multi-person shared three-dimensional virtual space can be realized 
as three-dimensional display is being performed for all viewers in the same virtual space. 

For example, a magnetic sensor having 6 degrees of freedom can be used as the 

25 viewpoint position detection sensor. The magnetic sensor can detect the current position by 
detecting magnetic flux cutoff in every respective direction x, y, and z. Assuming that the 
direction of the line of sight faces the center of the hole upon the mask and that a line 
connecting both eyes parallels the horizontal surface, that direction of the line of sight can be 
calculated in real time from the viewpoint position detected. 

30 Besides the magnetic sensor utilizing a magnetic field as described above, it is also 

possible to use any well known sensor utilizing an electric field, an electromagnetic field, 
ultrasonic waves, or the like, as the position detection sensor. In addition, the position 
detection sensor may be constructed integrated in the liquid crystal shutter glasses. 

The processing device 130 is provided comprising projecting an image for the 
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respective right and left viewpoint derived and time-divided, alternating displaying upon a 
display 112 synchronous to the liquid crystal shutters. Actually, as shown in FIGs 3(a) and 
(b), outputting images corresponding to the respective right and left viewpoints to the 
respective upper and lower half of the entire screen and switching between the respective top 
5 and bottom half thereof, this system displays enlargement thereof. This allows, for example, 
a display frequency of 120 Hz to be divided into 60 Hz to show the right and left images. 
The liquid crystal shutters switch between both right and left, viewable and non-viewable, by 
synchronizing with the image refresh rate. The fact that the display 112 is viewed through 
the liquid crystal shutter glasses makes it possible to obtain images that correspond to the 

10 respective right and left viewpoints, thereby allowing three-dimensional viewing. 

In the above description, the top and lower halves are output one at a time; however, 
in what manner division and display are carried out, or whether display is carried out without 
division, or if display is accomplished through interlacing or so forth, can be freely set. 
Further, besides a display device that provides a normal light-emitting surface to be directly 

15 viewed, a projector type display device may also be used. 
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<Viewpoint Position> 

Next, using FIG 4, how the position of both the left and right eye is calculated so as to 
perform three-dimensional display is described; where that position is derived, assuming the 
viewpoint position obtained using the positional sensor to be equal to the center of the eyes, 
based on the direction of the line of sight and the attitude angle derived from calculations. 
As shown in FIG 4, the center position of the user's eyes and the distance from the center to 
both of the respective eyes, the rotational angle of the light of sight from the straight forward 
direction, along with the position of both respective eyes are defined as the following: 



(Xeye/ yeye/ Zeye) 
deye 

e 

(Xl-eye/ yi-eye/ Zl-eye) 
(Xr-eye/ Yr~eye/ Zr-eye) 



center position between both eyes 

distance to both respective right and left eyes 

rotational angle of the line of sight from the 

straight forward direction 

position of left eye 

position of right eye 



a) 



When defined as in (1) above, the right and left viewpoint positions can be derived as 
the following equations (2): 
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Xl-eye X e ye — d e ye cos8 
yi-eye = y e ye ~ d eye SinG 
Zl-eye = Zeye 

Xr-eye = Xeye "~ deye COS0 
Yr-eye ~ yeye — deye SinG 
Zr-eye = Z e ye 



(2) 



In this case, if the positional sensor is constructed integrated with glasses 
10 incorporating liquid crystal shutters, error is especially small, and it is possible to calculate the 
viewpoint position from the positional information obtained by the positional sensor, as 
described above. 



<Setting of Projection Surface> 

15 When movement of the viewpoint position is considered, it becomes necessary to set 

the position of the projection surface so that it is capable of handling the positional 
relationship of the viewpoint and the display surface. The method where the projection 
surface and the display surface are made to match can be used as a most basic method of 
appropriately setting the projection surface. With this method, in the case where the absolute 

20 position of the display surface within the real world is invariant, the absolute position of the 
projection surface within the virtual world is also invariant, there is no need to consider 
correction of the absolute position of the projection surface, and it becomes acceptable to 
consider only the relative position from the viewpoint. 

In addition, when the position of a virtual object assumed to exist lies on the other 

25 side of the viewpoint relative to the display surface in real space, in other words, in the case 
where the display surface is thought of as a window and one is peering into the virtual world 
through the window, the projection surface should be set to match the display surface in the 
simplistic manner described next. 

However, generally, in the system for rendering the virtual world, since the virtual 

30 world in front of the projection surface relative to the viewpoint is impossible to render, in 
cases where a virtual object exists on the side in front of the display surface relative to the user, 
it is not appropriate to set the projection surface to match the display surface. 

Therefore, with the system of this embodiment, as shown in FIG 5(a), assuming the 
rectangular area, which has four apexes that match each respective intersection of the four 
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straight lines connecting each respective four nodes of a display surface 116 to the viewpoint 
and a plane at the rear of which the virtual object 520 exists parallel to the display surface 116 
to be a projection surface 510, the projected image is enlarged and displayed upon the display 
surface 116 providing appropriate presentation of an image. It is noted that in the case 
5 where such a method is used, since the absolute position itself of the projection surface 510 
changes, it is necessary to derive the absolute position of the projection surface 510 for every 
change in viewpoint position. 

FIG 5(b) shows an example of a display screen in the case where a relationship 
among the projection surface, the display surface, and the virtual object such as that shown in 

10 FIG 5(a) is assumed. If a relationship such as that shown in FIG 5(a) is assumed, that which 
is to be shown upon the display surface 116 in the real world is an enlarged image. 

In this manner, with the system of this embodiment, it is possible to freely set the 
relationship between the display surface and the projection surface. This makes it possible to 
display a virtual object by setting the projection surface without being limited to the actual 

15 display surface. 

<Derivation of Display Region and Display> 

A display region corresponding to the viewpoint position of the user is derived and 
image rendering is performed in that region. On this occasion, when the hole 118 upon 
20 display mask 114 is circular, the display region corresponding to the position of the user 
viewpoint is also circular, and the position of the center thereof is determined in conformity 
with the following two parameters. 

• Position of the viewpoint upon the display coordinate system 
25 • Distance between the mask and the display surface 

It is noted that with the system of this embodiment, the distance between the mask 114 and 
the display surface 116 is fixed. 

The center of the display surface 116 is made the origin, the coordinate system 
30 having the center of display surface 116 as the origin is set as shown in FIG 6, with the 
viewpoint upon that coordinate system, the distance between the mask and the display 
surface, and the position of the center of the display region being defined as the following: 



(Xeye, y e ye, Z e ye) : viewpoint position 
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dmask-dispiay '■ distance between mask and display surface 

(xcenter, ycenter, z ce nter) : center position of display region 

Based on the above-mentioned definitions, as shown in FIG 7(a), the center position 
5 of a display region 242 is derived from the following relational expression: 



^ mask-display 

X center ~ ~ X eye X j 
Z mta — CI 



eye mask-display 



mas k display 

y center y eye X 



^ eye ^ mask -display 



^center ^ 



(3) 



10 In addition, as shown in FIG 7(b) the radius defining the magnitude of the circular 

display region 242, is derived from the following three parameters: 

distance of the viewpoint from the display surface 
distance between the mask and the display surface 
15 radius of the hole upon the mask 

Here the radius of the hole 118 upon the mask 114 and the radius of the display region 242 are 
respectively defined as the following: 

20 rhoie : radius of the hole on the mask 

raraw : radius of the display region 

In this case, the radius rdraw of the display region is represented by the following: 



^eye 

25 r draw = r hole X 



7 -d 

eye ^mask-display 



By performing processing of the display region in the above manner, it is possible to 
perform display of an image for every user in the display region 242 that is dynamically 
derived in accordance with the position of the respective user. 
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<Detection of Overlapping Display Regions> 

Since there is a plurality of users, it is necessary to perform an overlapping search 
among regions derived in conformity with the processing described above. In the case where 
5 the display region is circular, detection of an overlapping region can be performed through 
the relationship of the distance between centers and the sum of the radiuses. With a system 
of this embodiment, when overlapping is detected, the users can be alerted to an overlapping 
display region through, for example, the rendering of a demarcation line for the display 
region. 

10 With the system of this embodiment, for example, the display has a rectangular 

shape with a width of 1360 mm and height of 1020 mm, and from the surface of the floor the 
height of the display surface is 1000 mm. The distance between the display mask and the 
display surface is 150 mm and the radius of the mask hole is 200 mm. 

<Other Embodiments 

The system of the embodiment described above is an example where the display 
surface is placed horizontally; alternatively, the display surface may naturally be placed 
vertically or at a slant. If the display is made to be the projection type, it is possible to 
achieve a large screen display. In addition, in order to configure a large display, a plurality 
of displays may be combined. 

FIG 8 shows a theatre-style multi-person shared three-dimensional display device 
capable of being used by multiple persons. With the theatre style multi-person shared 
three-dimensional display device, for example, given a width of 25 m, height of 18 m, distance 
of 6 m between the display mask and the display surface, radius of 0.5 m for the mask hole of 
the display mask, a maximum of forty-eight persons can simultaneously view the respective 
videos. 

It is not necessary to make the hole upon the display mask circular; for example, a 
rectangular shape is also allowable. 
30 If the display mask is configured with liquid crystal, it is possible to control the 

radius, shape, and location of the hole of the display mask through the permeability and 
non-permeability of the liquid crystal. 

In addition, in order to control the radius, etc. of the hole of the display mask, for 
example, a mechanical mechanism such as an aperture mechanism or the like can be used. 

10 
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With the multi-person shared three-dimensional display apparatus described above, 
glasses with attached shutters are utilized wherein the opening and closing of the shutters is 
synchronized and images corresponding to the left/ right line of sight are displayed to obtain 
5 a three-dimensional image; however, the present invention is not limited to this method for 
obtaining a three-dimensional view. For example, a filter based on polarization or color may 
be used as the glasses to be worn to segregate images corresponding to the left and right lines 
of sight. 

In addition, as an example of three-dimensional display not using glasses, there is the 
10 display device mentioned in, for example, Japanese Patent Application Laid-open No. 
2001-13457. 

It is possible to use these multi-person shared three-dimensional display devices, for 
example, for entertainment purposes. A configuration example corresponding to such 

15 entertainment purposes is shown in FIG 9. In FIG 9(a), audience members traveling aboard 
carts 421, 422, and 423, respectively, view a display 416 via a hole 418 in display mask 414. 
FIG 9(b) shows a configuration where a three-dimensional image displayed on a display 516 is 
viewed through a hole 518 in a display mask 514 while a plurality of audience members are 
moving about a central stage. 

20 When the fact that display on a display surface is possible by separating images for 

every person with a display hole is utilized, not only images for three-dimensional viewing, 
but also display of different information for each person is possible. An example of this 
configuration is shown in FIG 10. This configuration, as shown in FIG 10, is a fundamentally 
similar configuration as the multi-person shared three-dimensional display device shown in 

25 FIG 1. With this configuration, sensors 162, 164, 166 are attached to each audience member 
and the respective position of each audience member is detected through a processing device 
130. The processing device 130, in conformity with the detected positions, performs display 
corresponding to each person on the display regions 224, 226, 228 respectively associated with 
each audience member. 

30 

With the multi-person shared display device of the present invention, it is possible to 
perform appropriate display corresponding to viewpoint movement for a plurality of persons. 



With this multi-person shared display device, the relative positions between the 
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viewpoint and projection surface in the virtual world are appropriately corrected 
corresponding to changes in the relative positions between the viewpoint and projection 
surface in the real world. Moreover, with the present invention, for example with a single 
fixed display, a three-dimensional image can be displayed for a plurality of moving users 
5 having neither flickering nor spatial distortion. In addition, regions of viewpoint movement 
allowing a user to obtain an appropriate image have also been described in detail. 

The present invention is applicable to not only a stand-alone computer system, but 
may also be made applicable to, for example, a client server system or the like configured 
from a plurality of systems. 

It is possible to provide a configuration of the present invention by having a system 
read out a program relating to the present invention from storage media stored with the 
program and execute it. Such storage media includes floppy disks, CD-ROMS, magnetic 
tape, and ROM cassettes. 

INDUSTRIAL APPLICABILITY 

With the display device of the present invention, an image rendered upon a screen in 
compliance with the individual audience member positions is viewed via a hole of an 
20 appropriate size an appropriate distance from the screen. As a result, it is possible to view 
video in compliance with the individual viewpoint positions of a plurality of persons. 

Technology relating to such a multi-person shared display device is capable of wide 
range industrial applicability, for example as a device for viewing three-dimensional objects. 
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